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(57) Abstract 

A method and apparatus for reducing storage requirements for display data on a computer system (12). Data objects (22) to be 
displayed are organized into display lists and each data object includes an object type, such as text, graphic, and image. The data objects 
(22) are rastenzed into an uncompressed band buffer and divided into non-intersecting bitmap regions each identified with one or more 
object types. Each non-empty region is assigned a compression algorithm dependent upon the type of the region and specified compression 
constraints. The regions are combined with each other into larger regions if appropriate, and each region is compressed using its assigned 
compression algorithm into a compressed band buffer, thus reducing the required storage space for the data objects. The compressed data is 
decompressed m scan line order with a selected decompression algorithm corresponding to the assigned compression algorithms to produce 
uncompressed output data. The uncompressed output data is supplied to an output display device (16) for display 
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METHOD AND APPARATUS FOR REDUCING STORAGE 
REQUIREMENTS FOR DISPLAY DATA ~ 



CROSS REFERENCE TO RELATED APPLICATIONS 

5 This application is a continuation-in-part of co-pending parent patent application 
07/974,204, filed November 10, 1992 on behalf of Ronald S. Gentile, entitled, 
"Method and Apparatus for Processing Data for a Visual-Output Device with 
Reduced Buffer Memory Requirements," assigned to the assignee of this present 
application, and which is incorporated by reference herein. 

10 

BACKGROUND OF THE INVENTION 

The present invention relates generally to the display of data by output devices, and 
more particularly to a method and apparatus for reducing memory storage 
requirements when displaying data on an output display device. 

15 A computer system can output data to a wide variety of output display devices. 

Output display devices such as laser printers, plotters, and other printing devices 
produce an image or 'Visual representation" onto a sheet of paper or the like, while 
output display devices such as computer monitors develop visual representations on 
a computer screen. 

20 Many output display devices receive display data in the form of a "bitmap" or "pixel 

map" and generate visual representations from the display data. A pixel is a 
fundamental picture element of a visual representation generated by a display 
device/and a bitmap is a data structure including information concerning a number 
of pixels of the representation. Bitmaps that contain more than on/off information are 

25 often referred to as "pixel maps." As used herein, both bitmaps and pixel maps are 
referred to as "bitmaps." 



A printer can print dots on a piece of paper corresponding to the information of a 
bitmap. Alternatively, a computer monitor can illuminate pixels based upon the 
information of the bitmap. A "raster" output device creates a visual representation 
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by disp^ng the array of pixets arrange, in rows and columns from the bitm ap 
Most ou*u, evices. other than p^. are raster ^ * 

page o. Pocels corresponding ,o a primed or displayed page is reoeived and Jrad 
■n memory before the pixeis are displayed-by me output disptay devioe. 

A vieuat representation oan contain a number o, image types, including text 
graphics, p olographic images, etc. Data ofthese types can be efficiency stored in 
M-^W*^^. An-obiacf.asLemadto 
here,, ,s the da* and attributes deuntng a particufcr visual rep«on 2 
*~ can be edned or otbe^e manipuiated using an appticatton proglm 

dts lay device such as a primer or disptoy screen, tha objects are typicatty L 

btri (or "~' wo Mmaps - -« *»* *- S 

bitmap data in memory before displaying the data. 

Aprobtem ,„ the pdor ar, methods of providing bitmaps to output display devices is 

rr T, """^ ^^"^^"""^asttedeafre 
'! T' rePreSen,a " OTS * — — * has become mora 

prominent. For exam*, using a laser printer capable o, prinfrng btacK-and-white 

ZI ^TT" 0,600 *** " inch ,dp,) ' a * p,rai dispi ^ «• «m» 

bou«3.8X10 bytesofmemoty. vtfcen prin^g a page of color ptxata, tor example 
avmg 6 bKs per cotor per pixet, me memory rag™ increases to about 12 , x 

1 lt,lT w memo,y re,uiremerts ' a s ~ 

cos, of manufaaunng an output dispfcy device such as a taser printer is the cost of 
the required memory. 

A method that has been used to reduc. ,h, memory requirements for disptaying 
^-resolution images invoke the compassion of me bitmap da. accord, 9 „ 

ITT" - ° rate °* m - reduce 
he space needed to store bantaps by removing informal from bitmaps or outer 

0*0*. some compress™ Grimms am lossless", meaning that they compress 

data and reduce storage retirements no loss o, essemia, information This 
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type of compression is often used with text objects and the like, since text character 
codes often include extra information unrelated to the identity of the text characters- 
Other types of compression algorithms are "lossy", meaning that they compress data 
with some loss of information. These types of compression algorithms are typically 
used with image bitmap data, since the loss of information can often be unnoticeable 
in a high resolution image. When the compressed bitmap is to be displayed, it is 
decompressed using a corresponding decompression algorithm and sent to the print 
engine, monitor, or other output display device. 

A problem with the compression method of the prior art occurs when different types 
of objects are to be displayed by an output display device. For example, a page of 
data can include text objects such as words or paragraphs, graphics objects such as 
bar charts or geometric shapes, and image objects such as a digitized photograph. 
A compression algorithm that is good for text objects may, for example, be less than 
adequate for image objects, and vice versa. For example, lossy compression 
techniques may be adequate for image objects in that they can highly compress the 
image object data, but may be less than adequate for text objects, where the lost 
data would be apparent. A lossless compression technique is good for text objects, 
but may not adequately compress image objects. Thus, the selection of a single 
compression algorithm will almost always result in a less-than-optimal compression 
of mixed object types. 

SUMMARY OF THE INVENTION 

The present invention provides a method and apparatus for storing display data with 
reduced storage requirements. The present invention compresses multiple types of 
data objects using compression mechanisms that are optimized for each type of 
object according to user constraints. The compressed objects are then 
decompressed using a related decompression mechanism and sent to the output 
display device for display. 

The apparatus of the present invention includes a digital output processing system 
with selective object compression and decompression. A rasterizer converts data 
objects into bitmap objects of various types. A compressor compresses the bitmap 
objects with a selected compression mechanism. The particular compression 
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mechanism setected is dependent, a, £ m pa rt , on ^ „ „ 
, Wmap o^ec, ba.no compressed. Forexamp|e , „ me 

^DhT OT a " ' ma ' e the " " Compress " n mechanism best suited to text 
m. or ,mage date, respective*, is setected. The seiecuon of compj^ 
» atse depends on the s*e of the avaiiabie memory to ~ 

*** «— « — .he compressed bitmap regions in digite, reaTL 
memory assocated * an output devtee. A decompressor then decompresses! 

by the setected common mechanisms. The decompression mechanism for a 

used to compress the bttmap region. The decompressor men 
uncompressed b«map re ^s to an outpu, disptay device for d*CTuLL 
output d Kp ,a, devices inCude printer devices and dispiay sevens. 

The date objects input to the apparatos of the present invent are o^niaed into 
- ^ast one page tha, has munipte sevens. oa»ed "bands. The bandf'tel 
ha. a y, order on me pa 9 e, a* bands ofthe pa,, are dispiay^ Z ^ 
dev.ee in me dispiay order. The date objects are stored in 

^ground date . the band are rastenzed and divWed into non-interseebng bitmap 
na^ns wh,ch cover toe band. The regions are desfcnated as e»her empty regZ 
oovenng no objects, or non-em W ^ maing ^ ^ « ^ 

a^nedcomp^nalgomhms. The decompressor decompresses „ page a 
a *te by detemtining „be re an output scan >ne HenseCs regions on ,ha3 n 
and depressing the compressed regions when the scan ,ine inters! e 

^■^^P^-^ba^u^datato^ou^Lrrnl 
scan Una does not imersec (he compressed regions. 

* ^ °^ « and decomp^ion incudes steps of JT 

output date having a „pe and compress^g the output data 
compresston a,gor«hm chosen from a set of compression 
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compressed output data. The selected compression algorithm for the output data 
is dependent upon the type of the output data and meets a user's specified 
constraints for compression. The compressed output data is stored in digital 
read/write memory and is decompressed with a selected decompression algorithm 
to produce uncompressed output data. The decompression algorithm is chosen from 
a set of decompression algorithms and is dependent upon the compression algorithm 
used to compress the compressed data. The uncompressed output data is then 
supplied to an output display device. 

The output data is stored as objects in display lists including an object type and an 
object location on a page of data. The display lists correspond to multiple bands into 
which the page is organized. The objects of one of the display lists are rasterized as 
bitmap objects in an uncompressed band and stored in an uncompressed band 
buffer. The band is partitioned into non-intersecting bitmap regions, where each 
bitmap region has at least one type corresponding to the type(s) of the object(s) 
which the region covers, or an empty type if no object is covered. A compression 
method is assigned to each region based on the types of the regions and any user 
constraints that include the compression ratio of the compression method and visual 
quality of the data after being compressed and decompressed. Adjacent regions and 
regions which include empty regions between them, and having the same assigned 
compression method, are preferably combined into larger regions. The non-empty 
regions of the uncompressed band are then compressed and stored in a compressed 
band buffer of the digital read/write memory. This step includes checking if the 
compressed regions fit in the compressed band buffer when compressed. If the 
band doesn't fit when compressed, previously-compressed bands are decompressed 
and recompressed to provide more storage space for the compressed band. 
Another band of the page is then rasterized and compressed. Once all the bands 
of the page are compressed, a page of compressed data is decompressed in scan 
line order and supplied to the output device. Background display data is provided to 
the output device for portions of the page that are not included by compressed 
regions. 



An advantage of the present invention is that object data is compressed with 
compression mechanisms suited for each type of object included in display data. 
This allows much greater optimization of compression in that a compression 
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mechanism can be chosen for each otjac ,ypa tha, proves ,ha optaa, tradeoff 
betaeen m33 a cua% and M of compression. This parmhs a dramatic reduction 
,n memory space racuiramants * minima, los5 of image qua|i(y h 
areas o, a paga M indU de object disptay data are comp ressed so tha 
5 whttaspace. or ba^round areas do no, hava ,o be contpnaasad and stored 
memory. This allows an even greater reduction in memory apace requirements for 

to produce an output display device can ba drastically decreased. 

Z ITs 7 9 °' ^ ^ 5PeCW0aB0n — and a 

study of the several figures of the drawing. 
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& R IEF DESCRII^IONOFIHEDRAW!^ 

Figure lis a biock diagram of a computer system for dismaying a page Having 
objects of drfferent types in accordance with the present invention; 

inve'on ' ^ * " ^ **" ^ for USe With the t 

Figure 2a is a block diagram of a digital processor as shown in Figure 2; 

Figure 3 is a flow diagram H.ustrating the process of dismaying data with reduced 
storage requirements according to the present invention; 

Figure 4a isaflowdiagramiHustrating the first portion of the rastenze and compress 
input data step of Figure 3; compress 

Figure 4b is a flow diagram i„ustrating the second portion of the rasterize and 
compress input data step of Figure 3; 

25 input data step of Figure 3; compress 
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Figure 4d is a diagrammatic illustration of a page of objects, the page being divided 
into bands; 

Figure 4e is a diagrammatic illustration of a band including objects; 

Figure 4f is a diagrammatic illustration of the band of objects of Figure 4e that has 
5 been partitioned into non-intersecting regions; 

Figure 5 is a flow diagram illustrating a step of Figure 4a in which input object type 
and bounding box information is stored in collectors associated with bands; 

Figure 6 is a flow diagram illustrating a step of Figure 5 in which like objects in a 
collector are joined; 

1 0 Figure 7 is a flow diagram illustrating a step of Figure 5 in which object combinations 

in a collector are forced to free storage; 

Figure 8 is a flow diagram illustrating a step of Figure 4b in which a band is 
compressed; 

Figure 8a is a table of algorithm entries referenced by the process of Figure 8 to 
15 assign algorithms to regions; 

Figure 8b is a table of indexes into the algorithm table of Figure 8a for assigning 
algorithms to regions; 

Figure 9 is a flow diagram illustrating a step of Figure 8 in which non-intersecting 
rectangular regions are designated in the band to be compressed; 

20 Figure 9a is a diagrammatic illustration of a data structure describing a region of 

Figure 9; 

Figure 10 is a flow diagram illustrating a step of Figure 8 in which eligible regions are 
combined; 

Figure 11 is a flow diagram illustrating steps of Figure 10 in which regions are 
25 combined; 
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Figure 12 is a flow «a 9ram illusMng C step a, Flgure 8 in ^ , ■ 
attempted to be compressed; 

Figure 13 is a flow diagram iiiusbating a step of Figure 3 in which the compressed 
data is decompressed and displayed; and 

5 F W re 13a tea diagram illus , ration of aband ^ ^ 
decompress data. 

DETAILED DESCRIPTIO N OF THE PRFPPPp cn 

The present invention is well-suited for rpHnnnn -» 

. •' ^aror reducing the storage space requirements for 

~<^»a. tetob es e „ toanoutputdisptaydev|ce However, the present 

data of different types for a variety of purposes. 

Anumber C tenns are used herein ,„ describe images add retated 

oTr' r d pre ? ,o 8,6 ima9e ^ - - - ■ — 

or paper, d«p,a» screen, ete. The tenn •Image" is used ,o descnbe a type 

delayed «ua, rePre san«a«dn. TaKen coiieCeiy. ,he pfceis form th 
representation, ^reap- refers l0 fc ^ ,„ ^ J* 

M represent me pixeis. ,3 ^ ^ ^ ° 

strode lor outp^ng b,a* and wWe pixeis, where ea* pbcei eMl er is on or ^ 
» - - . map- hav,g m.re Nation for each pbrei. such as * co, ^ 
g^scaMspiaya.-Ras.er.asusedhe.in.re^^earmngemen.ofpixeison 

rranged m rows and coiumns. Raster ouipu, devices thus inCude J ^ 
-Pu*r d G p,a» S , Wdeo dtepiays. L CO d^ays. etc. lender- and ■ U J^Z 
"TT°^ toPto * a ~-chasac1 1 a ra c t er <JU ,t 

as data desonb,ng a wauai representation which is ,0 be dedved from ,ha objec, 
display 0, v,sua, representations includes one or more digHai computers ,2. a 
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communications bus 14, a printer 16, a display 18, or other output display device 20. 
The output of devices 1 6, 1 8, or 20 is a visual representation on a displayed page 22. 
Digital computers 12 can be personal computers (such as an IBM-PC AT-compatible 
or Apple Macintosh personal computer), workstations (such as a SUN or Hewlett- 
5 Packard workstation), etc. Computers 12 typically each include a microprocessor, 

a memory bus, random access memory (RAM), read only memory (ROM), 
peripherals such as input devices (keyboard, pointing device, voice recognizer, etc.), 
and storage devices (floppy disk drive, hard disk drive, etc.). In an alternate 
embodiment of the present invention, display data can be sent to other memory 
1 0 devices or storage devices instead of being sent to output display devices. 

Printer device 16 is an output display device that can produce a printed visual 
representation of a displayed page 22 on a piece of paper, a transparency, etc. In 
the present embodiment, printer device 16 is a raster device which creates the visual 
representation with a plurality of printed dots arranged in rows and columns 
15 corresponding to a bitmap. That is, a bitmap can be input to the printer device 16 
and the bits of the bitmap can be displayed as pixels. Alternatively, higher-level 
objects can be sent to the printer 16, and the printer can perform the rasterization 
process. 

Display 18 is an output display device that displays visual representations on a 
20 screen. Display 1 8 can include a cathode ray tube (CRT), which is typically operated 

as a raster device. Other types of displays include LCD screens, electroluminescent 
displays, etc. 

Other output display device 20 is any other form of device used to display a visual 
representation, in either a temporary or permanent form. Other output display 
25 devices include projection devices, plotters, etc. 

To display visual representations on an output display device, such as printer device 
16, display 18, or other output device 20, one or more types of procedures can be 
implemented. One procedure is to input data objects, and then rasterize bitmaps 
from the objects. For example, the object of a text character can include associated 
30 information which specify how the character is to be displayed, such as positional 
coordinates, size, font, etc. 



WO 96/41308 

PCTAJS96/09856 

A we,, known page descripfon |ansu ^ for specByjng ^ ^ 

^zrtT ascrip, "' an9ua9ebyAdobesysteTO - ,n "'~^. 

or toe ob*c can reference or poin, to stored out|ines ^ 

shape o, a cheater an, .dudes other restoring informal, s„* as font ana 

s*e. . A welH.nown character oudine forma, is me Type 1« forma,, b, Adobe 

S ^.^'"^,o^suc*as gra ph J oa l sh^ca„be s ^ a8grap ^ 
P« which are basic sha^ objecls use. ,0 for. more C0m , 6x ^ 
shapes. From the obiec*. ,he computer ,2 or output device ,6. ,. 0 2 ca 
• M» a b«map and e fe send the bHmap ,0 a memory cache or other sto " 
area that is accessible for display or store the bitmap for later use. 

The process of the present invention, as described below, pr<JvWes . tect)nique ,„ 
maniputebng bitmap, derived from objects so ,ha, iess storage space is rl « 
when d s ^ be - referent herein, a -page deacon Ju^ 

or PDL fiie ts a file or smalar storage unK which includes objecte stored i„ a 
^cnpbon language such as PostScript or PortaNe Document Forma,™ <P DF !, 
by Adobe Systems. v ; 

d D l P aTd d "Tf ^ reP> ~" s l~ ^ one 0, the oufput 

d^aydewceaie. 1S.and20. He^n, a "page- o, displayed da* rate. .0 a bl 
or group of visual rep.sente.ions that can be viewed by the user as a un« For 
example, a page of dispiayed representations from a printer device 16 can be the 
representations shown on a single shea, 0, paper ( or mora shoe., if a page 
defined ,0 span muitipie sh^ts o, paper, On a dispiay screen 18. a page can 
: compnse the .presentation shown a, one time on the scrcen, or can comprise a 
= n, of represented of which on, a potdon can be viewed a, a «me. I ^ 
™n^re te ms,cbas,hePos,Scnp,i rt erp^e,apageofda bfe J cay 
~ P ™ - - to - •** *- «» next 4e i 
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in die described embcdsnen,, dfeplay e d ^ a , ncludes 

1 h h ° """ Ch *— ere derived. ,„ ,he 

descnbe* embcdimant, three types of date objecte are addressed: lax, ob^ 
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graphics objects, and image objects. Other types of objects can also be defined and 
processed in alternate embodiments of the present invention. In the present 
embodiment of the invention, the type of an object can be defined by the commands, 
data, and operations used to display the object and the object's ability to be 
compressed/decompressed more efficiently and with less loss of quality using 
particular compression algorithms as opposed to other algorithms. For example, 
specific types of data (character codes), procedures, character outlines, etc. are 
used to describe a text object, which is known to compress more efficiently using 
particular algorithms. Thus; the type "text" is defined in view of these factors. Object 
types can be defined in other embodiments based on, for example, the final 
appearance of the displayed object, the resolution of the object as displayed, or other 
criteria. 

Text representation T is derived from a bitmap that, for example, was rasterized from 
text objects. For example, a character code in a text file can used to index a 
character drawing procedure which defines a text object, as is well known to those 
skilled in the art. Graphics representation G is derived from a bitmap that was 
rasterized from coded graphics objects, such as trapezoids and lines. These 
primitive graphics objects can be sized and shaped to describe the graphics object. 
Image representation I is typically not derived from any coded objects, since its 
original form is a bitmap, also referred to as an object. Scanned images, digitized 
photographs, etc., are data objects of the image type which are in bitmap form and 
can usually be displayed by an output display device directly or with a transformation 
of coordinates. 

Visual representations T, G, and i may all be displayed, and even overlap each 
other, on a single page of displayed data. These types of objects are each 
compressed into a band buffer using an optimized compression algorithm for each 
type of object, as described below in greater detail. 

Figure 2 is a block diagram of an output display device which, as an example, will be 
described as printer device 16. Printer device 16 preferably includes a buffer 24, a 
digital processor 26, RAM 28, ROM 30, I/O interface 32, and print engine 34. Buffer 
24 is a memory buffer used to buffer data received from computer 1 2. Printer device 
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16 may process inpu, data at a dWeren, rate man the rata ,ha data k output from a 
computer 12; buffer 24 is usad to interfaca these rates. 

Digital processor 26 inciudes one or more d^ta, integrated arcuifs used to contro, 
the operauon of printer dev*e ,6. Usin9 lnstruct|ons 

ndd,sptayofdataonou,pu,dev,ces. , nU ,e described enfant, a funcfio of 
processor 26 ,s to restate object data into bKmaps. Thereforo, in the pre* 
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PostScript printers. 
Processor 26 p^b, reads commar* s and data „ . 

~ T* T b * 24 and w — - ~ o 

rasta^a a btonap. The pressor fben composes the raste rized Wm ™ 
«-*. <e <be object types * * b,^ and ^ ^ 

component ,n ^ prinsng device, such as RAM 26 and ROM 30. Di^a, processor 
26 is described in greater detail with respect to Figure 2a. 

Bus 27 is used by digital processor 26 ,o access RAM 28 and ROM 30 which aie 
memo* component used ,o store data quired by «ha printer device 16 ,o process 
^ y> ouw data. RAM 28 is used by processor 26 as a genem, Z 
and as sc rat ch-pad memory, and is preferably used to store inpu, data L .he 
«~ data produced by me p^en t , venSon . Mu 28 ^ ^ 
w* one or more memo* chips. ROM 30 can be used to store insauctio^ Mowed 
by processor 26 as we,, as character outlines and ob^c primitives used ,o display 
..sua, repress in a ape* forma,. For exampie. when roster^ ^ 
ejects such as characters. ,he characters' asaociafed chancer oiaiines I be 

^cedihROM^wtoib.mapsofmacha.ctarsareras.er.edtobedisplayl 
as tea representations by the printer device. 

» Interface 32 is used ,o interface me b«map data generated by to mfcroprocessor 
w h me prin, engme 34. Oulpu, bitmap data can, for example, be sen, ,o I/O 
mterf.ee 32 via bus 2, I/O interface 32 provides ,he bitarap data ,o prin, ^ " 
wh*b uses the bitmap data to produca a disp,ay page 22 as showa in Figure 
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print engine of a laser printer, as is well known to those skilled in the art, typically 
includes such components as a toner mechanism for applying a visual representation 
to a piece of paper, feeding mechanisms, and other components required to produce 
a displayed page. If an output device such as a display screen is being used, the 
print engine can be a CRT or other actual screen which displays visual 
representations derived from the bitmap. Alternatively, output bitmap data can be 
sent directly to print engine 34 from processor 26 via direct line 31. 

The components shown in printing device 16 in Figure 2 can alternatively be included 
in computer 12 rather than print device 16 or any other output display device. For 
example, the digital processor 26, RAM 28, ROM 30, and I/O 32 can be included in 
computer 12 and can provide output bitmaps to print engine 34 located in the output 
display device. RAM 28, used to store compressed data, can be associated with the 
actual output display device that displays the visual representation and be located 
external to the output display device. 

The compression of displayed data, as described below, is implemented by digital 
processor 26 and can be accomplished on computer 12; the decompression of this 
data can then be implemented on an output device 16, 18, or 20. However, in such 
an embodiment, standard compression algorithms would preferably be used by 
computer 12 so that an output device could readily decompress data from any 
computer sending it data (or a description of the used compression algorithm would 
be sent with the compressed data so that the output device could understand the 
compression algorithm and decompress the data), if all compression and 
decompression takes place in the output device, as shown in Figure 2, standard or 
non-standard compression algorithms can be used. 

In an alternate embodiment, computer 12 can send compressed data to a storage 
device (not shown), such as a hard disk drive, floppy disk, PCMCIA card, magnetic 
tape, etc., for storage prior to displaying the data. 

Figure 2a is a block diagram of digital processor 26 shown in Figure 2. In the 
described embodiment, processor 26 includes a CPU 36 and an application specific 
integrated circuit (ASIC) 38. The CPU is preferably a general purpose 
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microprocessor which controls the operate, of printer device 16. CPU 12 can be a 
single-chip processor or can be implemented with multiple components. 

in the described embodiment. AS,C 38 is an integrated circuit designed to periom, 
. e compress™ and decompression operates. AS,C 38 uses compression 
5 aigontoms .ha, are preferably implemented in hardware in me ASIC The 
compression akjontoms are selected by software routines imptemented by CPU 36 
to compress b«maps so M the bitmap wil! require ,. ss space to slored fts|c 
38 *. uses decompress agomhms to, decompressing the compressed Mmaps 
backto metr originai size and torn, using prefers specked in me compress l 
date l -^-bodimenu.comp^ nanddecompressioncanb 
software or by ofher hardware component m the computer system. A RAM 38 can 
also be implemented locally ,o ASIC 38 to store structures and data used during 
compression and decompression. 
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£Z 7 T ^ lnuenfcn ute ™** «— ■ 

algonthms to ach,e»e a more efficient reduction in required storage space for a 
brtmap that is to be displayed with minima, loss of d, Spl ay ,ua,«y. as describe 

Figure 3 is a flow diagrem iHus.ra.ng me process 40 o, displaying date wfm reduced 
storage requirements according to the present invention. The process begins a, 42 
in Step44, a single page's content of input date is rasterized and compressed based 
upon rasterized pbjec types, step 44 enWis several individual steps, induding 

dtsplay hste ,n.o b.map objecte in bands, compressing .he bands according to the 
WPSS of ob,ecte tocated in ,he bands, and storing toe compressed bands in memory 
Th,s process is described in greater detei, wito respect to Figures 4a. 4b, and 4c By 
compressing the rastenzed date, the amoun, of memory required to store me date 
can be significantly reduced. 

in step 46. the digna, processor decompresses me compressed bands ,ha. have 
been Stored in memory and sends toe decompressed date, one band a, a Urn., to 
*e d,sp,ay engme. This is accompiished using decompression afcorithms and 



96/41308 PCT/US96/09856 

information stored in each compressed band. Data in a band is sent directly to the 
display engine to be displayed as soon as it has been decompressed. The page has 
been completely displayed when all compressed bands have been displayed. In an 
alternate embodiment of the present invention, the compressed band is 
decompressed and stored in a different memory or storage area for multiple uses, 
including display. The process of decompressing and displaying the bands of data 
is described in greater detail with respect to Figure 13. In next step 48, it is 
determined whether another page of data is to be displayed. If so, the process 
returns to step 44 to rasterize, compress, decompress, and display the next page's 
worth of data in steps 44 and 46. If there are no more pages to display, then the 
process is complete as indicated at 49. 

Preferably, a page of data can be compressed simultaneously with the display of a 
previous page in a document or other group of pages. For example, as data from 
the first page is still being decompressed or displayed in step 46, the second page 
in the document can be rasterized and compressed in step 44 simultaneously. 
Similarly, multiple pages can be decompressed simultaneously. For example, 
multiple tandem decompression engines can decompress multiple pages wherein 
each decompression engine decompresses and displays a certain color or shade on 
a side of a page. Each page can be passed through the pipeline of decompression 
engines, where each decompression engine receives the next page in the pipeline 
when it finishes with its current page. Such a process can also be used with the 
compression and rasterization of the present invention. In an alternate embodiment, 
instead of compressing, decompressing and displaying output display data on a 
page-by-page basis, each ,r band" or other portion of a page can be sequentially 
compressed, decompressed and displayed. 

Figure 4a is a flow diagram illustrating a first portion of the rasterize and compress 
input data step 44 of Figure 3. The process begins at 52 and implements three 
initialization steps 54, 56, and 58. In step 54, the compression level used for 
compressing data in the present invention is set to the lowest available level. The 
compression "level" determines the compression ratio for compressing data, where 
a lower level typically corresponds to a lower compression ratio (i.e., a lower amount 
of compression) as described herein. In next step 56, all bands on the current page 
are represented as a compressed form of whitespace. Whitespace (or "background" 
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dato, refers to white 0 r unmartred arcas of a page ma, do no. include any object dato 
to be dMayed in those areas. A page is pardoned Ho a number of band ^ 
each bend is anaiyied end compressed separate*. An exampto of bends 1 ,2 of a 
page 1 ,0 ere shown in Figure 4d and ere desonbed in further dew beiow The 
^pressed wWespace ^ „ stored „ ^ ^ ^ ^ 

Mm. in step 58. an emp* coHector is oAted and initiated ror ea ch band , 12 of 
cunrert page 1 ,0 so .ha, e»ery band has an assorted coilector A -cottector 

inst't^ 1 herei "' ' S ' ^ ^ " ^ ~ "** 

. struchons ma, store d*a associated w«h that ooiieotorts associated band Data 

s.ored.nmeooi^orisused.ooonrp^objec.sinoiudedin.heassodatedband. 
In next step 60. the process detenolnes whether one end o, ,he page has been 

5 11 T 7 be aetected ' ,or example ' by - 

jmendor^orfronrthepagedesohpfionianguage*. „ it is no, the end of 
.he page. ,hen stop 62 is impiementod, in which me process checks whether me 

'"P-^'restoredindispiayiisto.whi^e 
porhons of a,a,labto memory, sue* as RAM 28 and/or addtttona, memory. This 

rr»sHr v mi **~ ■** <* a «■ « — » 

<*sp.ay „s.s. If m,s occurs, me input objects in a selected band's display « „ 

^e.y^enzedartdmeband.^ssed.whioha^.hose ^.0*0.0 
be removed (orwrtten ^ „ the ^ |fet ^ ^ 

to stote add,bona, input ob*cte. Tn* procedu re „ _ as w _ ste ^ 
of me compress™ memod of me present invention are cyded .0 fee space in a 
d^tey «. A band may be compressed ha*g oniy a portion of «s inpu, ob^te and 
men decompressed ,o altow addMorta, *u objecte to be added (rasped, Wo me 

toir 7 trr ta r- k ^^^--^lz: 

o node 71 o, Rgure 4b to ccmpress me (possibjy incomptete, band, as de,ai,ed 
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PostScript language or in a different page description language as part of a page 
description file. In the described embodiment, the input object generally is an "object 
primitive" or "graphic primitive," which is a basic graphical object that has an object 
type. For example, the object can be a character or a word bitmap or code having 
a text type. The object can also be a trapezoid, line, or other primitive shape from 
which other, more complex, shapes are constructed; such a shape can be 
considered to have a graphics type. The object "could also have an image type, i.e. 
the object can be an image segment bitmap having pixels of defined location and 
color, if appropriate. In general, herein, "object" refers to the type, bounding box, 
and description data of an input object, and can refer to objects in bitmap form or in 
non-bitmap form. 

In step 66, the type and the bounding box (size and location) of the input object are 
stored in the appropriate collectors for the bands spanned by the object. The type 
of the object is one of several types that have been previously defined. For example, 
text, graphics and image types are described herein; additional types can also be 
provided. The type of an object can be determined from the input data describing 
the object. For example, if the input object has been specified in language such as 
PostScript, the type of an input object is evident from the commands of the 
PostScript file. PostScript can specify the type of a object in the context of the 
commands pertaining to the object, and a PostScript interpreter can be used to 
identify this type. For example, a SHOW (X) command is known to display text 
characters, so the object X is known to be of text type. When the input object was 
originally output by, for instance, a word processor, spreadsheet, or other PostScript- 
generating program, these commands were created in the PostScript file. If the input 
object was originally output by a graphics object type editor or drawing program such 
as Adobe Illustrator®, graphics-type commands (MOVETO, LINETO, FILL, etc.) 
inform the PostScript interpreter that the data has a graphics type. If the object was 
originally output from an image bitmap editor or program such as Adobe 
PhotoShop™, then the data can be identified from image type commands in the file, 
as is well-known to those skilled in the art. A PostScript interpreter can handle all of 
the other commands and information in a PDLfile, and provide just the input objects 
to the present process in step 64. 
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The location and *. o„he objec k adored in collectors, in ft. described 

rrrt ** io ~ e * an ^ * *- - «« «*— 

A funding box is a rectongle or o«he, po te on whose sides are po*ned m or just 
~- of «he objec, so tha, the 0*0. „ co mp ,e,e,y enclosed b y T 
r«ang,e. Four se,s of x, , <e. g „ hofeontal , ^ 
^asrbe^^o,^^^^^^^ J 

of .he our comers of ,he bounding box. Wtemal i ue ,, ^ sets J 
oppos te come, o, each bound* box can be stored as the ,oca 6 on of the 1« 
«er me»ods can aiso be used to descdbe toe boundin g bo, such as 
comerandthewidthandhei g htofthebox,etc. 

The appropnatecotieotorwtostoreanobieofstype and bounding box isde.em.ined 
fh^ob^ctspana. Assh^in^^,^,,^^ 

t Tetcr 11 * whfch are ^ ° f a ^ — - 

sttte T„e bands of F^une*, are shown as honzonta, secuons of a page- however 
- other entbodiments. bands can be denned as otoer areas Che pa* 

be processed a, one ta e so »a, toe en,* page 0, data does not have ,0 ^sted 

oandso, equa, s*e ,e. g . 256 ^ or scan iinea for each band,, athough ,n Z 
^mento the number and size of bands oan depend on the pa 2 

T"* • «» - °"*o -iiabie uncomp JL band 

ufer s telow , ^ ^ ,. hoiizonta| „ ^ ^ coofdiiate P * 

araii. ,0 a scan ,toe in «he dfcpiay ofoutputdata on an outpu, dispiay J^Z 
escnbed wrth reference ,0 Fi gure ,3. This dimenaon is sho« ale 
toenaon in F, gU te 4d. W or "Y coordinate- corresponding refers 

I P T 10 " hor20n,a ' dimension ' " d h sh ™ - - ^ 

dimension in Figure 4d. K M 

A number of objects are shown displayed on page 110. Both „. ^ M ^ 
b^ng box of each ob;ec, , stored in the approp^ collectors , ^ , ^ 

.ex, ^ and has a ove.il binding box ,20. Obiec, , 1B „ . g J phfcs ^ 
hawng a g raphics „pe and has an overs,, bound,n g box 122 oL« l«t a 
image obiec, having an image type and an overa,, bounding b x 1* 
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For an object that spans only one band, the overall bounding box of the object is 
stored in the associated collector of the band. However, an input object can span 
more than one band as well. For example, text object 114 spans bands 1 13, 1 15, 
and 1 17; graphical object 1 16 spans bands 1 15, 1 17, and 1 19; and image object 1 18 
spans bands 121, 123, and 125. In these cases, a "clipped" portion of the overall 
bounding box of the object is stored in a band's collector, where the stored bounding 
box is the intersection of the overall bounding box with the band. That is, objects 
which overlap multiple bands are preferably divided into multiple objects that each 
fit in one band and collector. For example, text object 1 14 is clipped such that only 
the coordinates of a bounding box in band 113 for object 114 are stored in the 
collector of band 1 13. Text object 1 14 is clipped again so that only the coordinates 
of text object 1 14 within band 1 15 are stored in the collector for band 1 1 5, and so on. 
Methods for clipping objects are well known to those skilled in the art. Alternatively, 
clipping can be performed at a later stage in the process before or during 
rasterization step 78 of Figure 4b. 

After the type and bounding box of the objects) have been stored in the appropriate 
collector(s), step 68 is implemented. In step 68, the input object is added to the 
appropriate display lists. For each band 1 12, an associated display list is created (or 
was previously created), and the current input object is added to the appropriate 
display list or lists, i.e., the data describing the appearance and content of the object 
is added to the appropriate display list. If an object overlaps more than one band, 
just the object data included in a band is stored in the display list associated with that 
band by a clipping process. Alternatively, ail of the object's descriptive data is stored 
in each display list associated with overlapped bands, and the object can be "clipped" 
before or during the rasterization step 78 of Figure 4b. Thus, ail of the object data 
on the page is grouped into the appropriate bands. This is desirable for data that is 
stored in a page description language such as PostScript, since the data of such a 
page description language is typically not stored in display order. The location 
(coordinates) of each object, known from the description in the page description file, 
determines the appropriate display list(s) on the page for that object. As input data 
is received, each object is placed in its appropriate display list, possibly grouped with 
other objects displayed in the same bands and thus stored in the same display lists. 
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In an alternate embodiment, dfepfey lis* do not have to be built. ,„ a page 
de^p,™ where data K ^ ^ ^ |n ^ d|sptey ^ 

can be d„ctly organized into bands and rastenzed as descnbed below. 

. r?r 8 '^ pracessretums, ° siep6awhere,heproress ^^'».e 

-dottbepagebasbeenreacbed. „„o, steps^a, again imptemented fcr 

^^process^^ne,,,,^^^^ lftrue . thisindicates 
ma, no o^ were tound l0 be displayed on me current page and thus no oejee* 
weres.ored.nd.piayiiats.acK.meprooessisoompieteatea If the dfcpiay J are 



7^ttT 8 *™ *" COn " nUeS me Ptecess 44 of Rgure 4a. From node 
"• fe ^ OT "'~«'^ep72,wheroacun,mba„d-A"i S se,eo t ed„hicHhas 

15 ' r^lr 8 ^ PreferablS ' bmdSare ^-"^o-,, e .. 1 beo^ 
that an output dev.ce displays the bands, typieaiiy starting , ro m me top ofthe page 
8o,n 8 to the bottom ofthe page. If a band haa no disptay ,ist entrtes, . is sM pU 
tn^an alternate embodiment, the dispiay B sts can be relieved in reverse dismay 

s°o 1' ,H V, T* 0rdSr ~ d ' SPla ' ed * " "** 

20 r jr* at *• ^ * soreen W ° UM "* ~ «*- 

*ws the ta s, dispia, « « is retrieved and ra s.erized to be aen, di^y to Z 

T disp,ayed without ta * B ,0 to -~- - *-* - 

it 2 7 , 4 ' v m ™ s ^ me tond " a " * »■ • — 

•oomor h° T "" C ° mPreS6ed W *"* a " d stete * ■» *• d e. 
impressed or -not compressed, for the « band oan be redleved *om a 

band necond . for example, the, stores such infom*,ion for eac* band torn th6 
^onpnxeas, dented betow, If the band A data is not in a compressed 
state, men the prooess continues to step 78, descnbed betow. Band A data typically 
» m a compressed sfcte m two circumstances. Band A may be a newly s Led 
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band, in which only the whitespace "background" data for the band was compressed 
in step 56 of Figure 4a. This whitespace data is in a compressed state stored in the 
compressed band buffer. Band A can also have been previously compressed in a 
"cycling" loop. If the display list storage was exhausted in step 62 of Figure 4a, then 
band A may have been previously selected and compressed. If so, it may already 
stored as compressed data in the compressed band buffer including some input 
objects and must be decompressed (in step 76) to add (rasterize) any additional 
input objects to the band. 

If the band A data is in a compressed state, then step 75 is implemented, in which 
the process checks whether there is an available section of the uncompressed band 
buffer to store the current band. As described below, the uncompressed band buffer 
is used to store an uncompressed band. If it is currently full from storing one or more 
other bands, then the process continues to step 77, in which band A (the current 
band) is set to a band that currently occupies a section of the uncompressed band 
buffer. The process then continues to node 97 to compress that band by the process 
of the present invention to free the uncompressed band buffer. This process is 
described below. Once that band is compressed, the uncompressed band buffer is 
available, and the process returns to step 72 (as described below) to again select the 
original band A (or, alternatively, another band). 

If there is a storage section of the uncompressed band available in step 75, then the 
process continues to step 76, in which the band A data (in the compressed band 
buffer) is decompressed into a storage section of the uncompressed band buffer 
using a decompression algorithm corresponding to the algorithm used to compress 
the data. Decompression is described in greater detail below with reference to 
Figure 12. 

The uncompressed band buffer is a memory storage preferably included in RAM 28 
that can store at least one band of uncompressed data. In the preferred 
embodiment, the uncompressed band buffer can store two or more bands' worth of 
uncompressed data. Each portion of the uncompressed band buffer that can store 
a band's worth of data is referred to as a "storage section" of the uncompressed 
band buffer. For example, the current band A is preferably stored in a first storage 
section of the uncompressed band buffer. The current uncompressed band is later 
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compressed and stored ft. toe compressed^ buffer ^ , ^ 

IS wn«en info the uncompressed band buffer, as described below. ,„ an alternate 
embodiment, muitiple uncompressed band buffers can also allow rasterizing and 
compressing of different bands to be performed simultaneously. 

5 Mar step 76, or » me band data is no, In a caressed sfate in step 74. then step 
78 is implemented. AH the disptoy « entries (cbjacts, o, band A are retrieved J 
ft^spteytettorbandA, rasterized into blftnaps, and stored in the storage secdon 
ofme uncompressed band fcrffer which hoHs toe decompressed date ftom step 76 
Ik. stotage secfton of toe uncompressed band buffer thus includes decomposed 

band mam step 76, and has rasterized bitmap objects added to ft in step 78. 

1117 h T* 9 3n into a °" raap ° biect is >° 

" n,he r Procedures and 

ohaacter „u,l,nes stored in ROM 30 can be referenced and used to create the 

a^ed^apofmecharactersoftoete^biec. If a graphics object is to be 
~,toen toe graphics primitives mafcng up fhe graphics object are rasterized 
ccondtng ,o es.ab.shed metoods and combined to torn, the rasterized graphics 
bftmap. An tmaga object may already be in bftmap form and thus may not need to 
be rasterized In oases where a 1-1 correspondence exists between image pixei 
space and output de«ce pixel space, tn casas where such a ccnespondence does 
not ex*, a Malkxl ^ ^ ^ ^ ^ ^ ^ ^ 

rastenzabon step as is weft-Known to those skiiled in toe art. The image bftmap 
0b,ec ,s stored wfth at! the other bftmap objects in the uncompressed band buffer 

tn ne*s,ep 80, toe process artempte to comprass toe rested^ data of band A that 
» aored ,n toe uncompressed band buffer. Th* step involves dividing toe bftmap 
Objecte «o non-intersecfing regions, asskjning types to toe regions, assigning 

eaZdt a ' 90rthmS '° *" ~° <° «*- ^ 

region data into a compressed band hnffer a » „ 

Dana buffer a » the current compression level. Step 
80 ,s descnbed ,n greater detail below with reference to Figure 8. 

in step 82, the process determines whether the compressed data for band A fits in 
theavanablememory of the compressed band buffer. The compressed band b^r 
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is preferably implemented in RAM 28 or similar memory. Since only a specific 
amount of memory is allocated in the compressed band buffer for all compressed 
bands, there is the possibility that the compressed data requires more storage space 
than the available allocated amount of memory. Note that, in the described 
i embodiment, the process preferably compresses and stores a small portion of 

uncompressed band data before compressing and storing the next portion of 
uncompressed band data. If the process writes compressed data to the compressed 
band buffer and runs out of storage space when data still needs to be compressed 
and stored, then the current band has overflowed the available storage space and 
does not fit. In the preferred embodiment, the process continues to compress data 
and counts the number of bytes of compressed data produced, but does not write the 
compressed data to the compressed band buffer. This allows the processor to 
determine the actual storage requirement of the compressed band. Alternatively, the 
processor can compress and write the overflowed data into the compressed band 
buffer over previously-compressed data for this band until no more data is available 
and the amount of overflowed data is known. 



Since the compressed band data does not fit, the process continues to node 83 of 
Figure 4c, described below. In alternate embodiments, the processor can calculate 
or assume that a certain amount of space is required without having to continue to 
compress overflowed data to find the precise storage requirements. For example, 
the processor can assume that a certain amount of storage space is required for the 
current band based on the compression algorithm (the compression ratio) used and 
how much data was stored before overflow, or by multiplying the available space by 
a predetermined number. 

In alternate embodiments, the current band can also be considered not to "fit" if it 
was not compressed within a user's constraints. For example, if the compression 
was not as efficient as expected, the band data would be using more storage space 
than desired and could be considered not to Tit", even though there is sufficient 
memory to store it. 

If the compressed band A does fit in the available memory space of the compressed 
band buffer, then step 84 is implemented, in which the process checks whether all 
display lists have been processed for the page, i.e., whether the display lists are 
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empty. If mere „ a«her display lis, ,o resize and compress, men «,e procass 
m.ums ,o step 72. If a. display «s hava basn rasfafead and compassed. L *. 
procass conges «o stop 86, where ,he procase checks if ■» las, compressed 
*«« Us, was a, lHa and of ^ page. ^ _ ^ „ disp , ay ^ ^ * 
-ta-d and comprassad bu, the and o, ,he pag a has no, bean raachad can occur 
whan d,sp,ay lis, storage is exhausted before al, inpu, da,a of a paga is addad ,o 

ob.acs from ma current P a 8 a naad ,o ha addad ,a display ,is,s. Thus, i, flre L 
comprassad display lis, is no, a, ,he and of ,he paga, fl™ the process JZZ 

added ,o ad B pla y fet ri » end „ „, ^ has ^ 

process is complete at 88. men me 

Figure 4c is a flow diagram IliusWing Ihe equation o, me process 44 shown in 
figures 4a and 4b. The process arhves a, node 63 whe, flre ras,enzad dam 

band bufler Prom node 83. dre process conflnuee ,o step go, in whk* fln. recess 
de,erm,nes t a higher level o, compression is avaflab*. i.e. if a compression Z 
(algonmm, is avaiiable ,ha, wii, reduce ,he storage ragmen* a, I Z d* 

" tm ^ m ' ** ^y, compresl 

Igontbms are ranked by numbar ^ on 
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hrcramhy. If there is no hfcner compression feve,, then a •failure- result is indicated 

mb JTf Pf0CeSS " *" ^ 38 indta3M * » ^ ' ««*- 
number o, compression ieveis. known compression raflos. and a large enouoh 

oompressed band bufler a* pm.ded so mat „ ^ „ ^ £^ 
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in step yb, the process cheeks if am, 

P-ous^mpreseed bands have no, been compressed a, T lZ 

comprass to n te ,el. This can be accomplished by checking „ 
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information stored in the band record. If all previously compressed bands are at the 
current compression level, then they have ail been recompressed (according to steps 
98-106 below) at the new compression level. The process then continues to node 
97 of Figure 4b, which implements step 80 to compress the band A data at the 
current compression level. 

If any of the previously-compressed bands have not been compressed at the current 
compression level, then step 98 is implemented. A previous band "B" that is stored 
in the compressed band buffer and was previously compressed at a lower 
compression level is selected. The selection of previous band B can be determined 
by several factors. In the described embodiment, the first compressed band in the 
compressed band buffer is chosen. In other embodiments, different bands can be 
chosen depending on how many bands are to be reanalyzed and recompressed in 
the implemented embodiment (described below). For example, only the single band 
just previous to the current band A can be chosen. 

In step 100, the selected band B is decompressed into the uncompressed band 
buffer using information stored in the band. Preferably, band B is decompressed into 
a "second" band storage section of the uncompressed band buffer so that both band 
A and band B are simultaneously stored in different storage sections of the 
uncompressed band buffer. To decompress band B, decompression parameters 
from the compression band buffer are retrieved. These parameters include the 
compression algorithms used to compress each region in the band and other 
parameters, as described in greater detail with respect to Figures 8 and 12. The 
process decompresses the previous band B, region by region, back into the second 
storage section of the uncompressed band buffer based on the decompression 
algorithms associated with the compression algorithm used for each region. The 
decompression algorithms perform the reverse operation of their associated 
compression algorithms. Note that an entire region is decompressed at a time from 
the compressed band buffer to the uncompressed band buffer, which is different 
from scan line decompression to a output display device as described with reference 
to Figure 1 3. 
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In step ,02. .he process attempts «o com£L band B data into ft. compressed 
80 o, Rgure 4b. and is descbbed in greater detei, wift reference to ^ * 

* hex, step , 04 . are process ctecRa » band Btits in fte compressed band butter 
^s,ep B acoon V ,is^ S i mi ,ad y ,o st ep 82?ssnownlnFioure4b ^ 
band B typicalt/ fits at the curren, compression tev«, sinoe tod ^ * 
us,n 8 fte previous compression ievei. and since fte compression JZTZ 
«*. oompression leva, usuatly achteves a higner compression ra B Jlplt 

, more ,oesy ftan me pre.orrs compressfcn tevei, ,o aiiow band B ,o^n 
smaller space. However, band B may no, « a, lhe curren, compress J 1 
•or exampte. ,o fte date o, band B no, being particuiany suited to ft, ^ 
compression atoonftm, e.g.. a teheed compress aigomhm J^ZZ 
^date. „ band B does no, m . then ^ 106 „ im 

■ reoompreaaed a, fte previous, iower session leve, wNch ia a>oady ^ te 
— — ceasftenreternsftstepgo^Cr^ 

the current compressron level to the next higher level. 

If compressed band B does fit in fte compressed band buffer h step ,04 ften step 
108 ,s fomented, in which fte impiemented poficy fe checKed. n fine 
embod,men, fte poiioy is ,o recompreas a,, previous bands a, JZZ 
compreas.ontevet This pofcyafiows .,, data of me same type wi„ appear ZZ 
me same guaiity on fte emire dismayed page, since an 0 , fte band were 
compressed a, fte same compression level having about fte same ioasineL Z 
step ,08. fte recess retems to step go ft compress anofter ZZJZ 
un M a„ previous bands are compressed a, fte curren, compression S^l 
prewous bands have been recompressed, curren, band A is comp" h 
curren, compress tevel. as shown in Figure 4b. . band A «s, d 
rasten.es and compresses fte nex, d*p!ay M as shown m Ffcure 4b. 

Merely, a policy can be impfcmented in which only jus, enough previous bands 
^repressed ,o afiow me curren, band A to r, ,„ fte compressed band but 

ml!irr ^ " S ° me ln9anCeS ^ tes «me ftan 

- ™<nod of reoompresaing a. pre*, bands (depending on bow many prev 
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bands have to be recompressed at this stage for other bands). However, in such an 
implementation, the quality of displayed objects may vary due to different 
compression levels being used on different bands. For example, defects might be 
visible between a portion of an image object in one, band that was compressed with 
5 one compression algorithm and the remaining portion of the image object in an 
adjacent band that was compressed with a different compression algorithm. If this 
policy is used, then, after step 108, the process continues to node 97 of Figure 4b, 
which causes band A to be compressed at the new compression level and checked 
if it fits. Alternatively, the process can determine when enough storage space has 
1 0 been freed by comparing the saved space from the recompression of band B to the 
known additional space needed for the current band A. 

The process of rasterizing and compressing output data as described in Figures 4a, 
4b, and 4c can be implemented in software and/or hardware. In one embodiment, 
the objects of the input data can be rasterized and the display lists, data structures, 

15 etc. can be stored through the use of software, while the 
compression/decompression can be implemented in hardware using gates, an ASIC 
(as shown in Figure 2a), etc. In other embodiments, the entire process can be 
implemented using software (or hardware). In many instances, however, a full 
implementation in software currently causes output data to be displayed too slowly 

20 for many applications. 

Figure 5 is a flow diagram illustrating step 66 of Figure 4a f in which the type and the 
bounding box of an input object are stored in the appropriate collectors for the bands 
spanned by the object. The process begins at 130, and, in a step 134, the process 
checks in step 134 if the new object can combine easily with a stored object of the 

25 same type that is stored in the collector. The objects stored in the collector are each 

examined and compared to the new object to determine whether the objects can be 
easily combined. An "easy" combination can be indicated by a number of conditions. 
In the preferred embodiment, if the bounding boxes of the new object and a stored 
object have equal or nearly equal Y coordinates for the top and bottom edges of the 

30 bounding boxes, the bounding boxes are no more than a small distance apart in X 

coordinates, and the objects have the same type, then the two objects are "like" 
objects and can be easily combined. These conditions also apply to objects having 
the same type and having equal or nearly equal X coordinates for the left and right 
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edges oftee ^ boxes and ^ ^ ^ ^ ^ ^ ■ 
V coor*a,es. Addflionaiiy. two ^ meel „. 

it rr o, r obiect * p °* ned ^ a "° ,h - «** 

b°x, and n the objects haue tee same type. 
> If me objeot, ^ te ^ ^ ^ ^ ^ 

°T s rr ■ and ,he prMess ,s ^ at i4e - step 

^nedeas^p^ep,^^^ MOflsu^ntsterageisavaiJabte 

- Step 144. as d^ed betpw. „ ^ is not enou , h ^ ^ 
.mptemented. in which . number of obm ^ ^ > 

- frece.ec*, Combining object s frees stotage. since *o combine, o^Ta 

^-d Of h»„ separate sets. The process o, forcing otject comblnatjons „ 
^"V**********^. After o*ec, combinations have 
been forced, storage ,a freed in the c*cter and step ,44 is impiemented. - 

in step ,44, me type and bounding box of the new object is stored in tee appropdate 
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Rgure 6 ,s a flow diagram iijus^ng step « of Rgure „ ^ 
ombjned v*in a coiJector. The process begins « ,48, and, in step 50 he 
M , box coordinates are reeved for tee netv object and tee sjred, £ 
obje«. Fo , exampie, in tee deacnbed embodimen,. a bounding box has four 
coord.na.es. The coordinates ofthe object, bounding boxes can L JZ£ 



For the stored object: 



X L = X coordinate of left edge of bounding box 
X R = X coordinate of right edge of bounding box 
Y T = Y coordinate of top edge of bounding box 
Y B = Y coordinate of bottom edge of bounding box 
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and for the new object: * 



X' L = X coordinate of left edge of bounding box 
X' R = X coordinate of right edge of bounding box 
Y' T = Y coordinate of top edge of bounding box 
Y' B = Y coordinate of bottom edge of bounding box 



In next step 152, any bounding box coordinate of the stored object are replaced with 
the corresponding bounding box coordinate of the new object if predetermined 
10 conditions are met. In the described embodiment, these conditions are as follows: 

Replace X L with the minimum of (X L , X' L ) 
Replace X R with the maximum of (X R , X' R ) 
Replace Y T with the maximum of (Y T , Y T ) 
15 Replace Y B with the minimum of (Y B , Y' B ) 

Thus, a stored object's coordinate in the collector is replaced with a corresponding 
new object coordinate only if the new object has a smaller or larger coordinate, as 
appropriate. Once these replacements have been accomplished, the process is 
complete as indicated at 154. 

20 For example, in Figure 4e, a band 1 12 of a page 1 10 is shown. Text object 124 has 

been previously stored in the collector of band 1 12. Text object 126 is a new object 
that is to be stored in the collector of band 112 as well. In step 134 of Figure 5, new 
object 126 is found to be adjacent to text object 1 24 and has the same type (text) as 
object 124. Objects 124 and 126 therefore qualify as "like" objects, and are 

25 combined in the process of Figure 6. Both objects have the same left and right (X) 
coordinates (i.e., X L = X' L , X R = X r R ), and the bottom Y coordinate of object 124 is 
the same as or is nearly equal to the top Y coordinate of object 126. In step 152, 
coordinates X L and X R remain the same, coordinate Yj remains the same, and Yg 
is replaced by Y'g. The new, combined object 135 thus has a bounding box having 

30 a left side at X L , a top side at Yj, a right side at X R , and a bottom side at Y'd. 



10 



15 



WO 96/41308 

PCT/US96/09856 

Figure 7 is a flow diagram illustrating step 142 of Figure 5, in which a number of 
object combinations are forced to free up storage in the collector for the new object 
P^erabV,only objects of the same type are forced No combinations in this process 
142. In the described embodiment, the number of combinations is an adjustable 
parameter that is greater than or equa, to 1. which the user can set before the 
process of the present invention is implemented. For example, a minimum of 2 
comb.nations can be selected. The minimum number of forced combinations can 
depend on the specific applications of the user. 

The process begins a. ,56. and in step ,58, tne p^ess examines stored otjects 

r*""" , **" , * t,W ~ ^embodiment, 
«h «*« s bounding box and type is compared ,o every other objetfs bounding 

n k ' n C °" eC * 0r ' w * 1 ' crl 030 °e accomplished according to one of several 
we, known meth0 ds. Foreacocol,ec te dobie«. a ,ecos,o,con,b W ng« 1 eobiec,„ B , 
eacb^ercoi^dob^of.hesame.ypeiscomputed. The -cos,- of combing 

^ob^.deponden.on^areaoffteresufcgcombinedobieo.meseparaaon 
dstencesbetweentne obfecS, tbes»sofeachob*c,. and even o,her pa.me.ers 
suchasbm, requlred ,o perform rhe combination, ate. An exampfe ofa costfuncta 
used for computing the cost of combining objects is as follows: 



20 



c = <*,fA - \ -\ * A)+ a, 



where 

a V a 2- a 3, and <*4 are tuning parameters, 

A u = the area of the bounding box that would result from doing the 



25 combination, 



A p = the area of the first bounding box in the proposed combination 
A q = the area of the second bounding box in the proposed combination, 



WO 96/41308 PCI7US96/09856 

Aj - the area of the intersection of the boxes that are proposed to be 
combined, 

S x = the minimum separation of the boxes in the X direction (zero if X 
coordinates overlap at all), and 

5 S y = the minimum separation of the boxes in the Y direction (zero if Y 

coordinates overlap at all). 

This function provides the cost, C, which is used in later steps. The first term 
of the function provides all the area that would be included in the combined object 
which is not included in the original two objects, i.e., the extra whitespace that would 

10 have to be included. Preferably, as little whitespace as possible should be included 
in a combined object, since compressing whitespace is wasteful of time and memory 
(as explained below). The second term of the function is similar to the first but 
provides a ratio to compare areas. The third and fourth terms provide the separation 
of the two boxes is X and Y directions, respectively. The tuning parameters a 1? etc. 

15 can be used to emphasize particular terms of the function. For example, if a user 
believes that the first term of the function (i.e. the a 1 term) is more important in 
determining cost than the other terms, then the parameter a 1 can be increased in 
value and the parameters a 2 , a 3 , and cc 4 can be lowered in value. A wide variety 
of other functions can also be used in other embodiments to provide a cost number 

20 reflecting these and/or other cost parameters. 

In step 160, the process selects the bounding box coordinates of the object pair 
having the smallest cost of combination as computed above in step 158. The 
bounding box coordinates for the two objects are retrieved as described in step 150 
of Figure 6. In an alternate embodiment, in step 158, the cost of combining an object 

25 with another object can be calculated for different pairs of objects until a cost C of 
combination results that is less than or equal to a designated threshold. Thus, in 
step 160, the object pair that first met this threshold would be selected. This 
alternate method can save computing time over the embodiment described above, 
since costs of object combinations are calculated only until the threshold is met, not 

30 for all the object combinations in the collector. 

In next step 162, the two selected objects are replaced with a new combined object 
having the same type as both the objects and having each bounding box coordinate 
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from one or me two objects. The coortfnates o, me combined object are preferably 
«erm,ned using the me mod ^ descrtbed above , p ^ 1(B ^ 

164. he process checks whether me deared number o, combinations have been 
om^ed. AS expired above, a predated number of combina«o„a oan be 
e, before e process beg.,, ,f me desire number of combMona has been 
cm men the p ro cess » comp,e,e ,f 16 6. „ „o,. then ma process continues 
•o step ,68. where , is checked whether more combines o, ob^s are pJZ 

Mora combiners are possible if mere a re a, ieas, object. , ,be collZtor 
U a - o^ „ more ^ ^ ^ * 

•ep 1 8 ,o compufa me coa, for two objecte having ,he same fypa as already 
c mputad, or for two objec* have a type daferen, fron, me type « any ^ 
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Figure 8 is a »ow diagram Bustrating st ap 80 of Rg„ re 4b. where «he process 
attempts to compress me data of hanrt a n. • ' fuceas 

obfea, • , • Sls aoccmpliahad by dividing toe band 

ob.ec* atto nonnma^ regions. a ssigning . 

ragtons, and a^ng to oompresa m. band, as deseed be,! The^rocess 

***** , the band is found. This is accomptisnad using the type and bounding 
box nfonaatron stored in ma ootiaotor asaociated with fhe band, and is described i 
greater detail below with reference to Figure 9. 

n?nl 4 ^r ramma, ' C ^ 1 12 °' * «• 

on .ntereeobng regions. A number of nonvoting tegions 128 are provided 

over ndaunounding obiects ,27. ,36, and ,37 aa a result of step ,82 A L£ 

aa reteuad to herein, is a non.vada.pin, recUngular area in a band m« 3 

re ,n*dee> soma dato podion of me band. Some o, regions are empty regions 

I* 1 r89l0nS 128 - -*» ,3,. which cover one or more 

27 »JT" " PfeferaMy S, °" d a separate " re *°" y 

oc II , T EaCh re9i0 " ' ' ^ 3 «* *— «*** W- 

, ^ ' yP6<S) * - - — "*™*« as 

desenbed below and wim reference to Figure 9a. 
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Referring back to Figure 8, steps 184-188 assign object types to the non-intersecting 
regions 128 found in step 182. In initialization step 184, each region is assigned an 
empty set of types and each region's "marked" flag (also preferably stored in the data 
structure) is set to false. The marked flag is used to distinguish whether a region has 
an empty type or not. An empty type indicates that the region covers only 
whitespace and no objects in the band. "In iterative step 186, a counter T is 
initialized to 0 and is compared to the number of objects in the band. Each object 
in the band is uniquely numbered and considered OBJECT(i). If i is less than the 
number of objects in the band, then step 188 is implemented. 

In step 188, for the set of regions covering OBJECT(i), the type of OBJECT(i) is 
added to each covering region, and each region's marked flag is set to "true." Since 
non-intersecting regions that cover the objects were found in step 182, all regions in 
the band either cover an object with the entire area of the region, or do not cover an 
object at all. Only regions that cover OBJECT(i) are processed in step 188; the 
coordinate data stored in the region data structures 221 and X- and Y-arrays can be 
used to determine these covering regions. If the type of OBJECT(i) is the same as 
a type that is already stored in a covering region, then no new type is added to that 
region. A region may cover two or more types of objects and thus may be assigned 
two or more different object types over different iterations of steps 186-1 88; a region 
having more than one object type is considered to have a "complex" type. The 
"marked" flags of the covering regions are set to true, indicating that these regions 
have been marked with a non-empty type. The process can later examine the 
marked flag to distinguish regions that have non-empty types and regions that have 
empty types, where a "true" flag indicates the region has a non-empty type. 

For example, in Figure 4f, region 133 covers both text object 135 and graphics object 
127. For example, object 135 is OBJECT(1) (i.e., i = 1) and object 127 is 
OBJECT(2) (i.e., i = 2) in the loop of iterative step 186. Region 133 is a region 
covering a portion of OBJECT(1) and a portion of OBJECT(2). Thus, the type of 
OBJECT(1) (i.e., text) will be added to region 133 when i = 1, and the type of 
OBJECT(2) (i.e., graphics) will be added to region 133 when i = 2. Region 133 
therefore has both text and graphics types, i.e., a "text-graphics" complex type. 
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After step 188, the process returns to step m to Increment counter i to the next 

OBJECT,,). Once even- object has had eac* covenng region processed, then i will 
^^a te r t han,h e nu mb e,ofob j eo tei n th eh a „ dl „s,ep 1 86. The process then 
• continues to step where a "bear compression afcontnm is assigned to ea" 

^onofo^ect^pesindudedinther^onw^sac^ngmeguaiityofthe 
^yed.magedenvedfromtn.region. Preten*,,, algontbms ana a Jg JJ^ 

on the current compression level and the type of the region. 

Interred embody, a,go*ms to assign ,o reg to ns are referenced in tables 

7," 35 " ' * «o Figures 8a and 8b The 

««. compresaon level and object , yI >es of a ^n are p^ed to the taHes to 

-"'"""^^^^ to***—.***, 
«b*e teble, For exampte. a compression afcorw™ « provides exeel|ent „J 

rate, for the other type. There thus may be a ^deoff bebveen visual qualrty and 
=o_ n ra «o for dtfferen, types <sucb as tex, and image types, Jen It 
*ten»nedbyuserconsb«s. The concession afconthm assigned ,o a region is 
P^ferab* store d in the data structure of M ™g,on. as shown below in Figure s 
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amTb H CharaClen " Sta can determine similar algonLs 

11 ° Ver ^ e * ^ '° Pr °* 3 "*™ or can 

*em,,„e a pamcular minimum compression r* to be used over the en« e page 

11 7! °' ^ ana '° r re9iOTS "'•»«• M have been 

"T and •** — * •«* Va. te be compnassed by examining 
date „ coifectma and in the band ™co ro . For exampfe, a region can be asagned th 
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same compression algorithm as a region across a band boundary. The time to 
compress or decompress a region can be different depending on the algorithm used 
and may be of concern to a user in a particular application. 



In an alternate embodiment, a region having a complex object type can be assigned 
5 a single type, where the single type is one of the types of the region. In such an 

embodiment, for example, the commands associated with an input object (received 
in step 64 of Figure 4a) could include information on how the object is displayed in 
relation to other objects. For example, the input object data could include information 
specifying if each object is transparent or opaque when displayed, and the "layering" 
10 of the objects on the screen, i.e., which objects are displayed over other objects. 

Using this information, step 194 can determine which single object type should be 
assigned to a region having a complex type based on the layering and transparency 
of the objects. 

In next step 196, the regions are examined and any eligible regions are combined 
1 5 with other regions based on specified criteria. These combinations are accomplished 

primarily to reduce storage space requirements of the regions according to, for 
example, limitations of hardware implementing the process. The combination of 
regions in this step is described in greater detail below with respect to Figure 10. In 
next step 198, the regions of the current band are attempted to be compressed into 
20 the compressed band buffer according to the assigned algorithms for the regions. 

Different compression algorithms can be used on different object types in a band to 
store rasterized bitmaps in relatively small storage space compared to the storage 
space needed if no compression or if a single compression algorithm were used. 
The steps of compressing the regions and storing them in the compressed band 
25 buffer is described in greater detail with respect to Figure 12. As explained above 

with reference to Figure 4b, the band data may not fit in the available space in the 
compressed band buffer. After the band is attempted to be compressed, the process 
is complete as indicated at 200. 

It should be noted that, in the described embodiment, the assigning of a compression 
30 algorithm to objects (step 194) and object combinations (step 196) are performed on 
rasterized object bitmap data in the uncompressed band buffer. Alternatively, 
compression algorithm assignments and object combinations can be assigned before 
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objecb t are -astefted and stored in tea unimpressed band buffer, su * as before 
step 78 of Figu re4 b. Also, assigning atgorithms and combinlng can ^ 
a, any time affer the band disp,ay list has been buil, bu, before perform^ me actoai 
compression of the band. 

5 Figure 8a shows an examp(e o, an atgorita ^ that ca „ ^ 

prov.de algorithm assignments ,o a region ,„ stop W of Figure 8. ,„ lhe described 
embedment, the atgorithm iook-up fabie is sfored in ROM 30 and oan be utifeed in 
~™«^ indexing^ fdescdbed below, te determine what combat* 
of avatobte compression afcorithms ,o asagn to a region. A number of algorithm 
entries a 1 is provided in fabie 202. where each algorithm enby 201 in d udes a „ 
Ktenb«er212. oneormore spe*d concession algorithms 20 3. « compress* 

" 2M -1 is accessed using £Z 

.enteier 2 2, and the agorittinKs, 203 and prefers 204 are then pltoed Z 
ass„ned to fhe region. For example, ff afcoritom enby , „ accessed, then the 

LZW ,s to be cascaded with a Oifferenfia, Pulse Code Modulation (DPCM, pmoess 
and ase,gned with tee parameters in M 204. Cascaded algorilhms operate b, 
pre-processing" the data using one algorithm (such as DPCM). and then 
contpresstng ,he pre-precessed date with the other algorithm (such as uw, 
^algon^mscanbeusedtoaoh^ved^comp.saionrauosthanwHen 
table 205, descnbed below with reference to Figure 8b. 

Some algorithm entries 201 have the same aigoritems listed in ffeld 203 bu, have 
ffferen. parameters listed in fleld 204. Common parameters are provided to 
adjus, tee compression process, and are we. known to those skilted in the ad For 
exampte. „ . DCT-baaed aigoritbm, a se, o, guanhzabon coeff,c,ente, a tereshotd 

eto Drffcre™ , parameters oan provide different compression ratio and compression 
* ,0 **" *° mhm «*■-■ F °' —* afcoritem enby 1 assigns LZW 
* PARA ™ I- ****m enb.3 assigns ^W* PARAMETERS^ 
Enby 1 may compress tex, a, one compression ratio and quality, white enb, 3 may 
compress text at a different compression ratio and quality. 
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It has been found that certain compression algorithms compress certain types of 
regions more efficiently than other types of algorithms. Thus, the described 
embodiment as shown in table 202 provides the LZW compression algorithm for text 
regions, the LZW compressionalgorithm for graphics regions, and a discrete-cosine- 
transform- based (DCT-based) compression algorithm (such as JPEG) for image 
regions. A Pixel Depth Reduction (PDR) algorithm can also be provided for cases 
when a deterministic compression ratio is needed, i.e., a compression ratio that is 
exactly known prior to compressing (other types of compression ratios are 
estimated). These algorithms, or cascaded multiple algorithms, can also be 
assigned to complex object types depending on user constraints, as described 
below. Other standard compression algorithms, such as Wavelet, RLE, Huffman, 
etc., or even non-standard algorithms, can be assigned to different object types and 
quality levels. Other types of algorithms can be cascaded, as well. For example, 
LZW or Huffman coding can be cascaded with a Run-Length Encoding (RLE) 
algorithm. The implementation of these compression algorithms (and 
decompression of data compressed with these algorithms) is well-known to those 
skilled in the art. 

Figure 8b shows an example of an indexing table 205 which can be used in step 194 
of Figure 8 to assign an algorithm entry 201 (as shown in table 202 in Figure 8a) to 
each non-empty region of the current band. Indexing table 205 is stored in ROM 30 
(or RAM 28) and can be utilized to assign an algorithm entry 201 according to object 
type and compression level. Indexing table 205 includes entries for different 
combinations of object types 206, which are text, graphic, and image in the described 
embodiment. For each possible non-empty combination of object types, there is an 
entry group 207. Thus, there are seven different entry groups 207 in the described 
embodiment, one group for each non-empty combination of three object types. 

Each entry group 207 includes one or more index entries 213. In the table 205, three 
entries 213 are shown in each entry group 207, but any number of entries 213 can 
be included in other embodiments. An entry 213 points to an algorithm entry 201 in 
algorithm table 202 which is to be assigned to a. region. Preferably, each entry 
includes three fields: an algorithm entry field 211, a quality field 208, and a 
compression ratio field 209. The algorithm entry field 21 1 stores a pointer (such as 
an identifier) to an algorithm entry 201 in the algorithm table, which is described 
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above in Figure 8a. This pointer provii ,he actual compression algorithm or 
M afconfhm combinabon to he assigned to a region. The goal, 
*ates the elated (or lossiKSS) „ ^ J» 

^^onusingthea^oritnmentryineelr.^t. In me described embcdil, the 
■ dueled Wcates the minimum ^compression teve, tna, is reguired t 
-m ft. en*, m fl etd 2, , t0 . ^ to , The ^ J '° 

denned above m steps 54 and 94 of Fl gures4a and 4c. The compreas^n rabo 
«-d 209 indicates me esbmated resufcg compression ratio when composing £ 
^on-gtbeaWhmenbyin^ll. Forexample , acompressto ^^ 

.nd.catesetatthedataiseaama.edtebecompressedata^rato Typ^h «! 
g^termerequiradcom^asionleveKw^eguaWintodzoe them 

and the greater the compression rabo Intdm ^ 

Anyone enby 2,3 in entry group 207 may be seiected for a region ■ Ihe re8 ,o n 

elrv 3 MnS,rain,S * CDraPreSSi ° n '* *"-—«. •** an 

entry 21 3 in a group 207 for a region. 

^example,* a region R has an objecttype of textonly, then the process examines 

text. Three index entries 213a 213b and ot^ ~~ • , _, 

' ZI,3D ' and 21 3c are included in grouo 207a 
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enby 1 prov.es a LZW agor«hm (and parameters, ,o be assign^ t ^ 
which is suitable fo, text compression. gned to region R, 
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desired, then entry 213a can be selected- if hinh ° iS 
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entry 213b can be selected. If region R has a complex type, such as text-image, 
then an entry 213 from group 207b would be selected in a similar fashion. 

Figure 9 is a flow diagram illustrating step 182 of Figure 8, in which a set of non- 
intersecting rectangular regions that covers all objects in the current band is found. 
The described process of Figure 9 is only art example, since there are many possible 
methods to provide non-intersecting regions from object bounding boxes. The 
process begins at 210, and, in step 212, an X-array is created having all X 
coordinates that describe left or right edges of object bounding boxes in the band. 
The left and right edges of the band are also included as X coordinates in the X- 
array. For example, X coordinates 139 as shown in Figure 4f are stored in the X- 
array. 

In step 214, the X-array is sorted in the order of increasing X coordinates, and 
duplicate X coordinate values are removed from' the array. The resulting array thus 
includes nX values. In step 216, a Y-array is created having all Y coordinates that 
describe top or bottom edges of object bounding boxes in the band. The top and 
bottom edges of the band are also included as Y coordinates in the Y-array. For 
example, Y coordinates 141 as shown in Figure 4f are stored in the Y-array. In step 
218, the Y-array is sorted in the order of increasing Y coordinates, and duplicate Y 
coordinates are removed from the array. 

Finally, in step 220, the band is divided (or "partitioned") into (nX-1)(nY-1) 

rectangular, non-intersecting regions. Each region can be labelled as R: = where 0 

■J' 

< i < nX-1 and 0 < j < n Y-1 . The extent of the coordinates (X, Y) of region Ry is thus 
Xj < X < X j+1 and Yj < Y < Yj +1 , where Xj is the ith X coordinate in the X-array (0 

< i < nX), and Yj is the jth Y coordinate in the Y-array (0 < j < nY). Note that, since 
discrete pixels are being displayed, two regions do not have the same coordinates 
on an adjacent edge. Thus, one region would have a right edge X coordinate of Xj - 
1 , and an adjacent region to the right would have a left edge X coordinate of Xj. The 
process is then complete at 223. 

As shown in Figure 9a, each region Ry created in step 220 preferably includes a 
data structure 221 stored in the region buffer. The region data structures are 
preferably ordered in "raster display order" (i.e. scan line order) in the region buffer 



WO 96/41308 

PCT/US96/09856 

96 

to .he top left come, o, fte regfcns so (ha, ,he decompnassor can rebieve 
<he reg,ons in .his order, as described below wHh referee .0 Figure 13. The dab, 
^^^^^^an^cf,^^^ 
master ftag 222, siave ftag 224. marKed fag 226. X tndex 228. V index 230 and 
* ..pes 232. Other forms 0, dam suture 22, can he used in oZ 

emhodimen,. Masterftag 222 and ai^ftag 224 are used ,0 im^emen, region 

» ■ used ,o ma* whemer a region has a nonempty typ e or an emp„ type (,ru 
« false, respeenvely), as described above. VW 

10 X fcdex 228 and Y index 230 descrtb* me tocabon 0, .he region in terms of indexes 

CLT x " aray and Y " aray ' re ~ and "» -~ 

^number of regions ,n .heir respects direcbons. These indexes specify a region 
by the region, ,o„e r coordina.ee. Per example, an ( X index. V 

1 5 ' Z! I" T ^ ' 2 ' ^ ' SeC ° nd - — ^d and J 

^^^ed B , 0 , flK ^ theM()nJ|natesofre8ten R ^ 

•» M V coords ,n the Y-anay to me fourth Y coordinate in the Y-array (minus 
D. Theseindexesappiywhenthemgionisneitheramasterors^e. ifmeLion 

region. „ the reg,on is a siave. me X and Y indexes 228 and 230 index the 
coordinates of the slave's master region. 

0*0 1 type M, 232 specifles ai, the o*c, «yp« „„ lch the ^ ^ 

rTuT : dimen '' ,ws fe imptemented as a 5 ^ * ■* — « > 

nciuded for each possible object type (not including me "empty type) „ . bit . on 

^^^^^nneededft.^^^^^^ 
uch as me ,oca*n 0, the region in tb. uncompressed band bufter and genera 
P-meters such as pixel depth and number 0, pfxets on a scan iine farther 0 
^ £,cb are used hy fhe compression process as desenbed * inference ,0 £ 

Note that ofter methods can be used in alternate embodiments ,0 provide a se, 0, 
non-m^ ^ aha, cover ,he ta nd Per example, a me,hod ^ ^ 



96/41308 PCT/US96/09856 

lists instead of the preferred coordinate array method described above can be used. 
In the linked lists method, each region can initially correspond to each object (as 
specified in the collector for the band) and can have a data structure including a 
bounding box and type description. Each of these region data structures can be 
included in a linked list, as is well known to those skilled in the art. If two regions 
intersect each other, then those regions are removed from the linked list and are 
divided into non-intersecting regions, and these non-intersecting regions are inserted 
into the linked list in place of the intersecting regions. Methods of manipulating 
linked lists as such are well known to those skilled in the art. Each two adjacent 
regions in the linked list can be similarly examined and replaced with, non-intersecting 
regions when appropriate. 

Figure 10 is a flow diagram illustrating step 196 of Figure 8 t in which regions are 
combined based on specific criteria. The process begins at 240, and, in a step 242, 
each row of regions is examined. A "row" of regions refers to all the regions in a 
horizontal row of the band (those regions having the same Y coordinates). A 
region's assigned algorithm is preferably compared to the assigned algorithms of the 
regions to the left and to the right of that region. In each row, adjacent regions that 
have been assigned the same compression algorithm are combined. Two regions 
can be considered "adjacent" if there are no intervening regions between the two 
regions. A method for combining regions is described in greater detail with respect 
to Figure 11. Preferably, two regions are combined, and the combined region can 
then be combined to additional adjacent regions if the algorithms are the same. This 
is the least "costly" combination of regions that can be accomplished, since no 
compromises in quality are made and storage space is saved. Thus, this 
combination is preferably performed prior to other region combinations, which are 
detailed below. 

In next step 244, pairs of non-empty regions having the same assigned compression 
algorithms are combined with empty regions separating the pairs if hardware 
constraints are violated on that row of regions. The hardware constraints of the 
described embodiment typically include a limit to the number of regions that can exist 
on a horizontal scan line. This limit is dictated primarily by the amount of available 
memory, e.g., in the ASIC 38. Thus, if there are more regions in a row than the limit 
allows, the hardware constraints have been violated. In step 244, intervening empty 
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step, then the assigned compression algorithms can be changed to an algorithm that 
provides better quality to a text-image complex object type. The region combinations 
can be performed as described with reference to Figure 1 1 . 

After step 248, the process returns to step 246 to check if hardware constraints are 
still violated on any row of the band. If they still are, then step 248 is repeated as 
often as necessary. Once the hardware constraints are no longer violated, step 250 
is implemented, in which vertically adjacent regions are combined when possible and 
when the "cost" is within limits. The "cost" here may be specified similarly as in step 
246. The vertical combinations are accomplished as described with reference to 
Figure 11. The vertical combinations are preferably accomplished after all horizontal 
combinations are completed in steps 242, 244, and 248. 

Figure 1 1 is a flow diagram illustrating the method of combining regions in steps 242, 
244, 248, and 250 of Figure 10. It is assumed that a group of two or more regions 
are desired to be combined. The method starts at 260, and in a step 262, the lower 
left region of the group of regions is designated the master region. The rest of the 
regions in the group are designated slave regions of the master region. This is 
accomplished in the data structure 21 1 of Figure 9a by setting the master flag to true 
for the master region and setting the slave flag to true for each of the slave regions. 

In step 264, the object type of the master region is augmented with all the object 
types of the slave regions. In the described embodiment, this is accomplished by 
setting the bits in the object type field 232 of the master region to all types included 
in the slave regions. Any duplicate object types are ignored. In step 266, the master 
region is marked with the boundaries of the set of slave regions. In the preferred 
embodiment, the master region's X-index and Y-index are set to the indexes of the 
slave region furthest diagonally opposite to the master region (i.e., the slave region 
that is furthest to the right and above the master). In step 268, each slave region is 
set to point to the master region. In the data structure 221 of Figure 9a, this is 
accomplished by setting the X-index and Y-index of each slave to the indexes of the 
master region. 



For example, if two horizontally adjacent regions are to be combined, the leftmost 
region is the master and has an X-index and Y-index of the slave region on the right 
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vr. 

for example, by ASIC 38. Each region descriptor preferably includes the height H (in 
pixels) and width W (in pixels) of the associated region, the location (e.g., 
coordinates) of the region on the page, pointer to the starting location of the region 
in the uncompressed band buffer such as a byte offset (used when compressing), 
pointers to the location of the region in the compressed band buffer, such as a byte 
offset from the beginning of the band (storedafter compressing the region and used 
when decompressing), pointers to the compression algorithm(s) used to compress 
the region, and general parameters such as pixel depth and number of pixels on a 
scan line for the region. This information can be determined from the attributes 
retrieved from the region data structure 221 and other system parameters. In other 
embodiments, the region descriptors can be stored in other areas besides the 
compressed band buffer, or can be created before the actual compression process. 

In step 278 1 the "compressor" (i.e., a processor and/or any related software 
implementing the appropriate compression algorithm) attempts to compress a non- 
empty region in the uncompressed band buffer using attributes from the region 
descriptor. The compressor attempts to compress the data for the current region 
from the uncompressed band buffer using the assigned compression algorithm and 
stores the compressed data in the compressed band buffer. 

This compressed data may or may not fit in compressed band buffer, as described 
above with reference to Figure 4b. If the compression is not successful, i.e., the 
compressed data overflows the available storage space, the process is complete at 
282. If the compression is successful, then the compressed region is marked as 
"compressed" in the "band record"; also, the starting location of the band in the 
compressed band buffer and the current compression level are stored in the band 
record. Step 281 is then performed, in which the process checks if another region 
is available to be compressed. If another non-empty region is available in the region 
buffer, then the process returns to step 276 to read attributes and compress the next 
region. If another non-empty region is not available from the region buffer, then the 
process is complete as indicated at 282. 

It should be noted that only non-empty regions are compressed and stored in the 
compressed band buffer. Empty regions in the band, i.e., "background" areas or 
pixels (whitespace), are not compressed or stored, since these regions do not 
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Next, the process determines the regions crossed by the next scan line in step 296. 
The first time this step is implemented, the "next" scan line is the first horizontal scan 
line at the top of the page. A "scan line", as referred to herein, is a horizontal line on 
the page that is traced from left to right (described with reference to Figure 13a). 
5 This is the typical direction of displaying pixels in raster output devices, and the data 
is typically provided to the output devices irvthe scan display order. Depending on 
the embodiment, scan lines can also be implemented as horizontal right-to-left lines, 
vertical, up-to-down lines, etc. Thus the terms "left", "right", "top", "horizontal", 
"vertical", etc. refer to left-to-right, top-to-bottom scan lines and may be changed 
10 appropriately in other embodiments. The next scan line is traced across the width 
of the displayed page to determine if any regions on the page are crossed by the 
current scan line. This can be accomplished by examining the height and width of 
regions and the location of regions on the page as provided in the region descriptors. 



In next step 298, the processor checks if a scan line pointer is currently within or at 
the left border of a region. The scan line pointer is the "front" of the scan line as it 
is traced across the width of the page in a displaying process. When first 
implementing these steps, the scan line pointer preferably starts at the top left comer 
of the page (the page can be oriented in any direction). The scan line pointer can 
either be within a non-empty region or within an empty region; the empty regions are 
referred to herein as "background" areas or background pixels. The background 
areas were not compressed and stored in the compressed band buffer, since there 
is no object data to store for these areas. 

If the scan line pointer is not within or at the left border of a non-empty region in step 
298, step 300 is implemented, in which background pixels on the current scan line 
are sequentially output to the display as the scan line pointer is moved left to right. 
When the scan line pointer reaches the starting (left) border of a region, or the end 
of the current scan line, no more background pixels are output (until the scan line 
pointer moves to another background area). The background pixels can be 
"whitespace" pixels, such as the white background of a white sheet of paper. 
Preferably, any attribute, such as color, brightness, etc., of background pixels can 
be specified by the user for whitespace pixels. 
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decompressed and the scan line pointer reaches the right border of the region, the 
process stops decompressing and displaying the region data. The process stores 
the location of the compressed band buffer where it stopped decompressing so that 
it will be able to start decompressing the same region data when the next scan line 
points to this region. The process preferably stores this location internally in 
registers of ASIC 38, but it can be stored in-other memories as well. 

in next step 308, the process checks if the scan line pointer is at the end of the 
current scan line at the right edge of the displayed page. If not, the process returns 
to step 298, where the process checks if the scan line pointer is pointing to another 
region, and background and region data is output accordingly as described above. 
When the pointer is at the end of the scan line, the process checks in step 310 if any 
region(s) have been completely decompressed and displayed ("completed"). This 
can be checked, for example, by determining whether any end-of-region information 
has been retrieved from the decompression buffer. If one or more regions have 
been completed, then, in step 312, a number of new region descriptors equal to the 
amount of completed regions are retrieved from the compressed band buffer and 
stored in the decompression buffer. By continuing with the process, new region 
descriptors are eventually added in from each successive band of data on the page 
(e.g., each band's region descriptors can be linked to the next band's region 
descriptors to effectively provide an entire page's worth of descriptors). 

Note that when the scan line pointer reaches the end of a band, then potentially 
multiple regions will have been completed, since no region extends over a band 
border. The maximum number of regions that can be completed at the end of a 
band is the maximum number of allowed horizontal regions. Thus, the maximum 
number of allowed horizontal regions can be influenced by the amount of region 
descriptors that can be loaded at one time into the decompression buffer. Since it 
requires time to load additional region descriptors from the compressed band buffer 
to the decompression buffer, it is desirable that the decompression buffer be capable 
of holding at least one more region descriptor than this maximum number so a region 
can be decompressed while new region descriptors are being loaded. 



If no regions have been completed in step 310, or after new compressed region 
descriptors have been loaded in step 312, then the process checks if the scan line 
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than a per page basis, and no scan line or scan line order is used. Each region can 
be entirely decompressed at a time to memory, and the decompression state does 
not have to be continually saved and retrieved each time a scan line intersects the 
region (as in, for example, steps 76 or 100 of Figures 4b and 4c). Likewise, the 
decompression of a particular region does not have to be continually interrupted 
depending on the path of a scan line. In addition, multiple decompression processes 
can be implemented simultaneously in the decompress-to-memory embodiment, 
since no sequential scan line display constraints apply. 

Figure 13a is a diagrammatic illustration of the process of decompressing a band as 
described in Figure 13. A band 320 of data includes two bitmap regions, 322 and 
324. When displayed, these regions are positioned on a background area 326. A 
scan line 328 starts at the left edge of the band and background pixels are output 
until the left border 330 of region 322 is reached. The decompression state stored 
at the beginning of region 322 is read by the process from the decompression buffer 
and the state is stored in the state buffer. The size of the height H1 of the region is 
pixels is then read from the associated region descriptor so that the process will 
know when the decompression for the region is complete. The width W1 of the 
region in pixels is also read and this amount of region data in the compressed band 
buffer is decompressed and output. This moves the scan line pointer to the right 
edge of region 322, and the location in the decompression buffer where the 
decompression left off is stored, for example, in RAM 39 or ASIC 38 (this location 
can also be stored in RAM 28 or another storage location). The process then 
outputs more background data until the scan line pointer moves to the left border 332 
of region 324. Since this is at the beginning of region 324 (i.e., the first time the data 
of the region has been pointed to by the scan line pointer), the decompression state 
for this region is stored in a different area of the state buffer. The compressed data 
of region 324 on the current scan line is then decompressed similarly to region 322. 
Once the scan line pointer reaches the right border 334 of the band, a new scan line 
336 starts at the left border of the band just under the previous scan line. In Figure 
9a, scan line 336 is shown at an exaggerated distance under scan line 328 for clarity. 
Background data is output until the scan line pointer for scan line 336 reaches left 
border 330 of region 322. At this point, the process reads in the decompression 
state for this region from the state buffer, the size W1 of the region, and the location 
in the compressed band buffer where the decompression for region 322 left off on 
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the previous scan ft. 328. The procesl then decompresses the data from the 
compressed band buffer (or region 322 Thjs fmm 
regions of the page. 

WN. t* invention has been descdted in temrs of seveta, prefen-ed embodiments 
,s contended that a»e ra( ions, medians and permutations thereof w. 

ZTf rr ,o ,hose swiied in ,he art upot a readin9 0,1,16 spe * ata - 

study of me drawtngs. rorettampta, other types ofobjects besides tea, graphics 

Weffic^contpressfcose^pes.inaddMon. other page descriptaiangueges 
may mhet^y present objecls in . dispby ^ ^ ^ fc ^ 

herem are no, requited. The mapping of octets to compression a g o«ms can *o 
ema„ severe, possibles; for i„ stance . one or more types ^ 
compressed with many possibte aigodUtms, and, correspondingiy, one or more 
afconthms can be assigned ,0 many possibte types of objeas. The oonsb* te 0, the 
user utomateiy de te rm,ne me compression aigonthms used, and «hese consents 
can tnclude time ,0 comp^s/dacompmss or display the data; storage space 
availa* for the dispiay ,s*. uncompressed band buffer, compressed band leT 
e c, the guality of ms resuming disptayed visual repmsen.aKon ma, Is denved from 
«te ob.ee*; and other ta«ors, such as ove ra „ page oha.otens.ics 
hardware/software limitations, etc. 

Furthermore, certain .ermtnology has been used for the purposes 0, desenphve 
a my, - not ,0 limit the p^ent lnvention . „ „ ^ 

ZZ7r T *** a " SUCh — - 

Peculations as M within me tnte spirit and scope of the ptasen, invention. 

25 What is claimed is: 
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CLAIMS 



1. A system for processing data objects each representing display data for a 
display area and each having a data type and a location in the display area, 
5 comprising: 

a divider for dividing the data objects into a plurality of non-overlapping 
non-empty regions, where each region contains all or part of at least one data object 
and each region has a location and a region type derived from the data types of the 
data objects in the region; 

10 a plurality of compression mechanisms and decompression mechanisms, 

where each compression mechanism has an associated decompression mechanism; 

a compressor that selects one of the compression mechanisms for each of 
the non-empty regions according to its region type and then uses the selected 
compression mechanism to compress those portions of the data objects found in the 
1 5 region, thereby producing compressed data objects; 

a memory coupled to the compressor for storing compressed data objects; 

a decompressor coupled to the memory that decompresses compressed data 
objects to produce uncompressed data objects by applying to each compressed data 
object a decompression mechanism associated with the compression mechanism 
20 used to create the compressed data object; and 

a monitor coupled to the compressor, decompressor, and memory for 
detecting when the memory is becoming full and triggering the decompression of 
previously compressed data objects and the recompression thereof to free up space 
in the memory. 
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a piuralrty o, uncompressed date object Mo a single data objecl , where; 9 

me object combiner is i„„ ok ed when the monitor has de.eo.ed ,he memory 
is becoming full; and y 

data ejects acco rdi n g to predefined chteria to be receded by he corner 
resutong ,n the freeing up of space in the memory. compressor 
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3. The system „, daim 2 wherein the objeo combiner combines uncombed 
ate ob le cte into a singte data objeo, when a « of combining me £T 
— * - separa to „ be*een .be ob W , > u „der a 



• ,™* S f ^ °' 3 — * th * «»- - combine * determined by .he 
to me amoun. of date included in the objecfc «ha. were to be combined 
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adiacen, d , T ' *"* ** *** 

ad,acen, date objeds ,ha, are of the same .ype and combining non-adjacen. date 

rr - ** Mme ,ype inhe *- ~* - 

does not contain any data objects. enioojects 
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6. The system of daim . turner comprising a disday engine coupled to receive 
uncompressed date objects hen. the decompressor. 
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7. The system of claim 6 where the display engine is one of the group consisting 
of a laser printer engine, a plotter, and a CRT. 



8. The system of claim 1 further comprising an embedded computer comprising: 
5 a computer processor, and 

a program memory coupled to the computer processor; and 

a display engine coupled to receive uncompressed data objects from the 
decompressor; 

where 

0 the display engine is coupled to the embedded computer; and 

the compressor and decompressor are implemented as computer program 
instructions tangibly stored in the program memory. 



9. The system of claim 1 further comprising: 

means coupled to the decompressor for displaying the uncompressed data 
objects; and 

means for updating a pointer to indicate a next portion of a display area to 
display such that when the pointer intersects a non-empty region the decompressor 
decompresses and outputs the compressed data associated with the non-empty 
region and when the pointer does not intersect a non-empty region the 
decompressor outputs background data. 
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10. A system for processing data objels each representing display dau for a 
page and each naving . dala ^ and a |ocaaon on ^ ^ 

dMded ,nto bands, the system comprising: 
a memory; 

5 a dtap* M i„ the memory tor each' Band of the page for storing <„ ose 

portrons of the data objects found in the band; 

3 *» <° <**» »s. memory tor dividing the data objects in 

eao bar* * a piuraKy of non-ovedapping ' 

«*» a,, or pad of at feas, one dafc object and each regfcn has a iocation and 
10 ^""'^^'-"ithedatatypesoftheda^objecteintheregton; 

° ,COmPreSSi ° n - <■—*-*« mechanisms, 

, *-^-P— -^nismhasanassocia^deoomp^ionmechanism; 

a «"*"-» *- — i one o, me compression mechanisms for each o, 

1 5 11 T" ""*" '° - C ° neSPOndinS "*» ^ — — 
™,on mechanism to compress the data object found in the region, thereby 

Pnoduong comprised da, objects, and stores comp.ssed data objects in me 

ob te c K ^r PreSSOrC °* ed '° ,he,nem ^ ,ha,deCOmpreSses -™P^da,a 
20 T7 ^""^^^^^^'"eachccmp^^ 

T:ZZT*' me0han ' Sm ™" h - <°~ -ban, m 

used to create the compressed data object; and 

detecJoTt " M * d '° C ° mPreSSOr ' - —cry for 

when the memo* is becoming full and fdggering the deoomp^n of 
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The system of claim 10 further comprising: 
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a rasterizer coupled to the display list memory to rasterize the data objects 
to produce bitmaps stored in the non-empty regions; and 

a raster output device display engine coupled to receive uncompressed data 

objects; 
5 where 

the compression mechanisms operate on bitmaps to produce compressed 
bitmap data objects; and 

the decompression mechanisms operate on compressed bitmap data objects 
to produce uncompressed bitmap data objects for the raster output device display 
10 engine. 



1 2. The system of claim 1 1 further comprising: . 

means for updating a pointer to indicate a next portion of a band to output to 
the raster output device such that when the pointer intersects a non-empty region the 
decompressor decompresses the compressed data associated with the non-empty 
region and outputs it, and when the pointer does not intersect a non-empty region 
the decompressor outputs background data. 



13. A method for processing data objects each representing display data for a 
display area and having a data type and a location in the display area, the method 
comprising the steps of: 

(a) receiving the data objects; 

(b) storing the data objects in a display list associated with the display area; 

(c) dividing the display area into a plurality of non-overlapping non-empty 
regions, each region including one or more data objects or portions of data objects 



10 



15 



20 



WO 96/41308 

PCT/US96/098S6 

and each region having a iccation and a type derived from me date types o, 
the date objects and portions of date objects in the region; 

(d, providing a piurality o, compression mechanisms and decompression 
mechanisms, where each compression mechanic has an associated 
5 decompression mechanism; 

(e)oomp re s Sl ngm,dateob i e«si„eachnon.mp, yre9lonbyselec|in90ne 
of .he compression mechanisms acc^n, to the corresponding region type and 
compressing the date objects and portions o, data objects in the r^on ^ 
producing compressed data objects; ' 

m storing the compressed data objects in a memory; 

DO decompressing each compressed data object by sefccfttg a 
depress™ mechanism associated * the compression mechanism us* , 0 
^"-P^^o^anddac^^jhaco^^^^ 
to produce uncompressed date object; and 

<h) monitoring to detect when ». TOmory „ „ fri99e Hn g ,he 

rzr; * previou% eon ~ da,a ■** - - 

thereof to free up space in the memory. 



14. The method of claim 13 further comprising the steps of: 

when tT"™ 9 3 PlUrality ° f mCOmPreSSed date ^cts into a singie data object 
when the memory is becoming full; and 

compressing the singie data object to free up space in the memory. 
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15. The method of claim 14 wherein objects are combined when a cost of 
combining the objects, determined by the separation between the objects, is under 
a predetermined threshold. 



16. The method of claim 15 wherein the cost of combining is determined by the 
amount of background data that is included in a combined resulting object compared 
to the amount of data included in the objects that were to be combined. 



17. A method for processing data objects each representing display data for a 
display area and having a data type and a location in the display area, the method 
comprising the steps of: 

receiving the data objects; 

establishing in the display area a plurality of non-overlapping bands; 

dividing any data objects that span more than one band into multiple data 
objects that are each located in only one band; 

establishing for each band a display list associated with the band; 

storing the data objects located in a band in the display list associated with 
the band; 

dividing each band into a plurality of non-overlapping non-empty regions each 
having a location and a region type derived from the data types of the data objects 
in the region; 

providing a plurality of compression mechanisms and decompression 
mechanisms, where each compression mechanism has an associated 
decompression mechanism; 
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compressing a first band of data objects by seiecting one of the compression 
mechanisms for each non-empty region in the first band according to the 
corresponding region type and using the seiected compression mechanism to 
compress the data objects in the region, thereby producing compressed data objects; 

storing the compressed data objects in a memory; 

compressing and storing the raining bands in the display area by applying 
to them the preceding two steps, respectively; 

decompressing each band of compressed data objects by selecting for each 
compressed data object a decompression mechanism associated with the 
compression mechanism used to create the compressed data object and 
decompressing it to produce an uncompressed data object; and 

monitoring to detect when the memory is becoming full and triggering the 
decompression of previously compressed data objects and the recompression 
thereof to free up space in the memory. 



18. The method of claim 17 further comprising the steps of: 

sending the uncompressed data objects to an output display; and 

determining where an output scan line intersects the regions ofabandsuch 
that the compressed regions are decompressed when the scan line intersects the 
*v regions. 



19. The method of claim 17 further comprising the step of: 

sending the uncompressed data objects to an output display; and 

outputting background disp.ay data for portions of the page not covered by 
uncompressed data objects. 
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figure 4d 
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